Fluctuations in Stationary non Equilibrium States 
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In this paper we formulate a dynamical fluctuation theory for stationary non equilibrium states 
(SNS) which covers situations in a nonlinear hydrodynamic regime and is verified explicitly in 
stochastic models of interacting particles. In our theory a crucial role is played by the time reversed 
dynamics. Our results include the modification of the Onsager-Machlup theory in the SNS, a general 
Hamilton-Jacobi equation for the macroscopic entropy and a non equilibrium, non linear fluctuation 
dissipation relation valid for a wide class of systems. 
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The Boltzmann-Einstein theory of equilibrium ther- 
modynamic fluctuations, as described for example in 
Landau-Lifshitz states that the probability for a 
fluctuation from equilibrium in a macroscopic region of 
volume V is proportional to exp{VAS/k} where AS is 
the variation of entropy density calculated along a re- 
versible transformation creating the fluctuation and k is 
the Boltzmann constant. This theory is well established 
and has received a rigorous mathematical formulation 
in classical equilibrium statistical mechanics via the so 
called large deviation theory g]. The rigorous study of 
large deviations has been extended to hydrodynamic evo- 
lutions of stochastic interacting particle systems || . In a 
dynamical setting one may asks new questions, for exam- 
ple what is the most probable trajectory followed by the 
system in the spontaneous emergence of a fluctuation or 
in its relaxation to equilibrium. The Onsager-Machlup 
approach j| answers precisely to this question: in the sit- 
uation of a linear hydrodynamic equation, that is, close to 
equilibrium, the most probable emergence and relaxation 
trajectories are one the time reversal of the other. Devel- 
oping the methods of J3| , this theory has been extended 
to nonlinear regimes g. Onsager-Machlup assume the 
reversibility of the microscopic dynamics; however micro- 
scopically non reversible models were constructed where 
the above results still hold, ||, 0] . 

Emergence of large fluctuations, including Onsager- 
Machlup symmetry, has been observed in stochastically 
perturbed gradient type electronic devices H. In their 
work, these authors study also non gradient (i.e. non 
reversible) systems and observe violation of Onsager- 
Machlup symmetry. 

In the present paper we formulate a general theory 
of large deviations for irreversible processes, i.e. when 
detailed balance condition does not hold. This ques- 
tion was previously addressed in . Natural examples 
are boundary driven stationary non equilibrium states 
(SNS), e.g. a thermodynamic system in contact with two 



reservoirs, but our theory covers, as a special case, also 
the model systems considered in ||. In our approach a 
crucial role is played by the time reversed dynamics with 
respect to the stationary non equilibrium ensemble. 
Our results are: 

1. The Onsager-Machlup relationship has to be mod- 
ified: the emergence of a fluctuation takes place along 
a trajectory which is determined by the time reversed 
process. 

2. We show that the macroscopic entropy solves 
a Hamilton-Jacobi equation generalizing to a thermo- 
dynamic context known results for finite dimensional 
Langevin equations as those studied in B. The 
Hamilton-Jacobi equation can be solved perturbatively 
if we consider not too large fluctuations. 

3. We test our theory in a stochastic model of inter- 
acting particles system, the boundary driven zero range 
process, in which we perform the computations explicitly. 
In particular it is possible to construct the microscopic 
time reversed process and to write the macroscopic en- 
tropy in a closed form. 

4. For a large class of systems we obtain a non equilib- 
rium non linear fluctuation dissipation relationship which 
links the macroscopic evolution of the system and of its 
time reversal to the thermodynamic force. 

We are interested in many body system in the limit of 
infinitely many degrees of freedom. The basic assump- 
tions of our theory are the following. 

1) The microscopic evolution is given by a Markov pro- 
cess X t which represents the configuration of the system 
at time t. This hypothesis probably is not so restrictive 
because also the Hamiltonian case discussed in Q in 
the end is reduced to the analysis of a Markov process. 
The stationary non equilibrium state (SNS) is described 
by a stationary, i.e. invariant with respect to time shifts, 
probability distribution P st over the trajectories of X t . 

2) The macroscopic behavior of the system is described 
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by diffusion type hydrodynamical equations of the form 

d 

dtp = J2 d ^ (P) d -i P} = F (P) (!) 

where p = pt{u) represents in general a vector of thermo- 
dynamic variables, e.g. the densities of different species 
of particles, and Di.j is a matrix acting on this vector. 
The interaction with the reservoirs appears as boundary 
condition to be imposed on solutions of (|l|). We assume 
that there exists a unique stationary solution p of (Q), 
i.e. a profile p(u) which satisfies the appropriate bound- 
ary conditions such that F(p) = 0. 

These equations are derived from the underlying mi- 
croscopic dynamics through an appropriate scaling limit. 
The hydrodynamic equations represent laws of large 
numbers with respect the probability measure P s t con- 
ditioned on an initial state Xo. The initial conditions for 
(|l|) are determined by Xo. Of course many microscopic 
configurations give rise to the same value of po(u). In 
general pt(u) is an appropriate limit of a pN(X t ) as the 
number N of degrees of freedom diverges. 

3) The stationary measure P s t admits a principle of 
large deviations describing the fluctuations of the ther- 
modynamic variables appearing in the hydrodynamic 
equations. This means the following. The probability 
that in a macroscopic volume V containing N particles 
the evolution of the variable pjv deviates from the solu- 
tions of the hydrodynamic equations and is close to some 
trajectory p t , is exponentially small and of the form 

P st (p N (X t ) « pt(u),t £ Ma]) « e-tfMAiH'W] 

= fWlfl (2) 

where J(p) is a functional which vanishes if pt is a so- 
lution of (0) and S(p tl ) is the entropy cost to produce 
the initial value pt 1 ■ We adopt the convention for the 
entropy sign opposite to the usual one, so that it takes 
the minimum value in the equilibrium state. We also 
normalize it so that S(p) = 0. Therefore J(p) represents 
the extra cost necessary in order that the system follow 
the trajectory p t . Finally p^{Xt) w Pt(u) means close- 
ness in some metric. This formula is a generalization 
of the Boltzmann-Einstcin formula in which we set the 
Boltzmann constant k = 1. 

4) Let us denote by 8 the time inversion operator de- 
fined by 8X t = X- t = X%. The probability measure P* t 
describing the evolution of the time reversed process X t * 
is given by the composition of P s t and _1 that is 

P* t {X* =<f> t ,t E Ma]) = Pst(X t =<t>- t ,te [-ta,-h]) 

(3) 

We assume that the time reversed SNS also admits a 
hydrodynamic level of description. 

Let L be the generator of the microscopic dynamics. 
We remind that L induces the evolution of functions 



of the process according to the equation d t E[f(X t )] = 
E[(Lf)(Xt)], where E stands for the expectation with 
respect to P st conditioned on the initial state X$ Jl2| . 
The time reversed dynamics is generated by the adjoint 
L* of L with respect to the invariant measure P%n , that is 
E p ™ [fLg] = E p%n [(£*/)#] .The measure P in , which is the 
same for both processes, is a distribution over the config- 
urations of the system and formally satisfies L*Pi n = 0. 
E in is the expectation with respect to P, n and /, g are 
functions of the configuration. We require that also the 
evolution generated by L* admits a hydrodynamic de- 
scription, that we call the adjoint hydrodynamics, which, 
however, is not necessarily of the same form as (|l|). In 
fact the adjoint hydrodynamics can be non local in space. 

In order to avoid confusion we emphasize that what 
it is usually called an equilibrium state, as distinguished 
from a SNS, corresponds to the special case L* = L, i.e. 
the detailed balance principle holds. In such a case P st is 
invariant under time reversal and the two hydrodynamics 
coincide. 

We now derive a fundamental consequence of our as- 
sumptions, that is the relationship between the action 
functionals / and I* associated to the dynamics L and 
L*. From equation ^ and our assumptions it follows 
that also P* t admits a large deviation principle with func- 
tional I* given by 

7f tl)t3] (p)=7 M2 ,_ tl] (^) (4) 

with obvious notations. More explicitly this equation 
reads 

S(Ph) + J* tlM (p) = S ^ + J{-t 2 ,- tl ](0p) (5) 

where p tl , pt 2 are the initial and final points of the tra- 
jectory and S(pti) the entropies associated with the cre- 
ation of the fluctuations pa starting from the SNS. The 
functional J* vanishes on the solutions of the adjoint hy- 
drodynamics. To compute J* it is necessary to know the 
macroscopic entropy S, which is determined by the mi- 
croscopic invariant measure Pj„ . We shall see that S can 
be also obtained as the solution of a Hamilton-Jacobi 
equation involving only macroscopic quantities. From 
we can already obtain the generalization of Onsager- 
Machlup relationship for SNS. 

The physical situation we are considering is the fol- 
lowing. The system is macroscopically in the stationary 
state p at t = — oo but at t — we find it in the state 
Pq. We want to determine the most probable trajectory 
followed in the spontaneous creation of this fluctuation. 
According to (Q) this trajectory is the one that minimizes 
J among all trajectories connecting p to po in the time 
interval [— oo, 0]. From (Q) we have 

J[-oo,0](p) = </[O,oo](0P) + S (M (6) 

The right hand side is minimal if J* , (8p) — that 
is if Op is a solution of the adjoint hydrodynamics. The 
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existence of such a relaxational solution is due to the fact 
that the stationary solution p is attractive also for the 
adjoint hydrodynamics. We have therefore the following 
generalization of Onsager-Machlup to SNS 

"In a SNS the spontaneous emergence of a macroscopic 
fluctuation takes place most likely following a trajectory 
which is the time reversal of the relaxation path accord- 
ing to the adjoint hydrodynamics" 



Let us assume J of the form 



J[tuU]iP)=o dt(W,K(p)W) 



(7) 



where W = dtp-F(p), F(p) has been defined in ffl), (■, •) 
denotes integration in the space variable and K(p) is an 
appropriate positive kernel which we assume to be known 
and reflects, at the macroscopic level, the stochasticity of 
the system. This form of J is typical for diffusion pro- 
cesses described by finite dimensional Langevin equations 
H and is what we expect if the hydrodynamic equations 
are of the diffusion type ([!]). This is also what we find 
for the model discussed later. 

From (||) or (||) we have that the entropy is related to 
J by 



S(P) 



inf Jj-oco]^) 
p 



(8) 



where the infimum is taken over all trajectories connect- 
ing p to p. Therefore S must satisfy the Hamilton-Jacobi 
equation associated to the action functional J. A simple 
calculation gives 



i /ss K _ x , ss 
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(9) 



One can try to solve this functional derivative equation 
by successive approximations. Let p(u) be the stationary 
profile in the SNS. If we expand S as a Volterra functional 
series in the argument p — p, equation (^) reduces to a 
system of equations for the kernels of the expansion which 
can be solved by iteration. Applications of (||) to variuos 
models will be discussed in [ fL5| . 

We consider now the so called zero-range process 
which models a nonlinear diffusion of a lattice gas, see 
e.g. |Q. The model is described by a positive integer 
variable r\ T (x) representing the number of particles at site 
x and time r of a finite lattice which for simplicity we 
assume one-dimensional. The particles jump with rates 
g{q{x)) to one of the nearest-neighbor sites x + 1, x — 1 
with probability 1/2. The function g(k) is non decreasing 
and g(0) = 0. We assume that our system interacts with 
two reservoirs of particles in positions N and —N with 
rates p+ and p- respectively. The microscopic dynamics 



is then defined by the generator |l4| 
1 N 

(L N f)(v) = 2 E 9(v(^m x ' x+1 f + ^ x - 1 f] (10) 

x = -N 

+ \p + \f{ri N ) mi + \p-[f(v- N ) im 

where V x > x±1 f = f(rf- x±1 ) - /(ry) and 

!n(z) if z^x,y 
■q{z) - 1 if z = x 
n(z) + 1 if z = y , 

that is, rf' v is the configuration obtained from rj when 
a particle jumps from x to y. Similarly r/ N,N+1 (N) = 
r)(N) - 1, n- N - N - 1 (-N) = r)(-N) - 1 and r) N (r)- N ) 
is the configuration r\ after addition of a particle at the 
point N(-N). 

It is remarkable that the invariant measure for this 
process can be constructed explicitly jlj]. It is the 
gran-canonical measure obtained by the product of the 
marginal distributions 

P N ( v (x) =k) = — r^TTT^v 1 ^) (11) 



where 



and 



9(1) ■■■9(k) 



Xn{x) = 2±zp^ x , p++p- 



2(N+l) 



z N (x) = i+jr ^ (3!) 

fr[ 9W ■ ■ ■ 9{k) 



(12) 



(13) 



We emphasize that, if p_ ^ p + , the generator L^f is 
not self-adjoint with respect to the invariant measure so 
that the process is different from its time reversal and 
detailed balance does not hold. 

Let us introduce now the macroscopic time t = t/N 2 
and space u — x/N and the empirical density 

1 N 

PN(t,u) = — ^ rj NH {x)S(u-x/N) (14) 



-N 



Then one can prove that in the limit N — > oo the em- 
pirical density (|lj) tends in probability to a continuous 
function p t (u) which satisfies the following hydrodynamic 
equation 

d tP = ~d u {D(p)d u p} = \dl^p) = F{p) (15) 
where <fi(p) is the inverse function of 
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(16) 
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where Z(<f>) is the normalization constant as in (|13|). The 
function </> is well defined because the right hand side of 
([TJ) is strictly increasing in <fi > 0. Then p(<j)) is the 
equilibrium density corresponding to the activity <f>. The 
boundary conditions for ([TJ]) are 0(p t (±l)) = p±. 

From the knowledge of the invariant measure one can 
calculate the adjoint generator L* N given by 



1 N 

{L* N f)(r!) = - Y, 9(v(x)) 



\ N (X + 1)™,-+! 



Xn{x) 

~ E 9in{ X )) XN[x ' 1) —' 1 



f (17) 



x=-N 
N 



x=-N 



X N (x) 



f 



+ h N (N)[f(r 1 N ) f(r,)} + lx N (-N)[f( V - N ) /(„)] 



Notice that the form of (|T7|) is the same as (|10|) with the 
rates modified in such a way to invert the particle flux. 
From ([Tt]) one can derive the adjoint hydrodynamics 



dtp = \dUip) 



adu{ W) } 



F*(p) (18) 



p+-p- 



P+—P- 



The 



. > u ~\~ ^~~2 and t-j — , 
boundary condition for ( |i~8| ) are the same as for ( [151). For 



with X(u) 



the detailed computations we refer the reader to jl5fl . 

The second term on the right hand side of ([TJ) is pro- 
duced by the new rates in (|l7|). As expected, it is pro- 
portional to the difference of the chemical potentials. 

In this model one can compute the action functionals 
J(p) and J*(p). The result is 

J[HM(P) = (v^W^V^W^ (19) 

where, W* = dtp — F*{p). Moreover J and J* are de- 
fined to be infinite if pt does not satisfy the boundary 
conditions stated above. 

The entropy S(p) can be easily computed from the 
expression (O) for the invariant measure 



S(p) = / du 



p(«)log^P-log Z( ^ (u))) 



\{u) 



Z(X(u)) 



(21) 



From equations (|l|), © and (|l|), one can ver- 
ify explicitly equation (||) and the generalized Onsager- 
Machlup relationship. 

We deduce now a twofold generalization of the cele- 
brated fluctuation-dissipation relationship: it is valid in 
non equilibrium states and in non linear regimes. Such a 
relationship will hold provided the rate function J, 



[ti,k 



of 



the time reversed process is of the form (^|) with the same 



metric K(p) but a different vector field F* describing the 
hydrodynamic of the adjoint process, namely 

J [trM^ = l[ 2(lt ( W *> K (P) W *) ( 22 ) 

By taking the variation of the equation (|^), a simple com- 
putation gives 



F(p) + F*(p) = -K(p)-^ 



(23) 



This relation holds for the non-equilibrium zero-range 
model discussed before. We also note that it holds for 
the equilibrium reversible models for which the large de- 
viation principle has been rigorously proven such as the 
simple exclusion process j^] and the Landau-Ginzburg 
model |ll| and its non-gradient version [p0| . It is also 
easy to check that the linearization of (|23|) around the 
stationary profile p yields a fluctuation-dissipation rela- 
tionship which in equilibrium reduces to the usual one. 
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